COMMUNITY COLLEGE 
STUDENT SUCCESS: 



WHAT INSTITUTIONAL 
CHARACTERISTICS MAKE A 
DIFFERENCE? 



Thomas Bailey, Juan Carlos Calcagno, Davis Jenkins, 
Gregory Kienzl, and Timothy Leinbach 

Community College Research Center 
Teachers College, Columbia University 



October 2005 



CCRC Working Paper No. 3 



Corresponding author: 

Juan Carlos Calcagno 

Community College Research Center 

Teachers College, Columbia University 

525 West 120 th Street, Box 174 

New York, NY 10027 

Tel.: (212)678-3874 

Fax: (212)678-3699 

Email: jcc2111@columbia.edu 



This research was funded by the Ford Foundation. The work reported here has also benefited 
from research funded by Lumina Foundation for Education (as part of the Achieving the Dream: 
Community Colleges Count initiative) and the U.S. Department of Education (as part of the 
National Assessment of Vocational Education). All errors are solely ours. 





Table of Contents 



1. Introduction 1 

2. Existing Research 3 

3. Empirical Model and Data 7 

3.1 Econometric Models 7 

3.2 Dataset and Variables 10 

4. Findings 19 

5. Robustness and Limitations of the Results 22 

6. Discussion 24 

Acknowledgements 27 

References 28 




Abstract 



The goal of this study is to determine the institutional characteristics that affect the 
success of community college students as measured by the individual student probability of 
completing a certificate or degree or transferring to a baccalaureate institution. While there is 
extensive research on the institutional determinants of educational outcomes for K-12 education 
and a growing literature on this topic for baccalaureate institutions, few researchers have 
attempted to address the issue for community colleges. Using individual level data from the 
National Education Longitudinal Study of 1988 (NELS:88) and institutional level data from the 
Integrated Postsecondary Education Data System (IPEDS), we address two methodological 
challenges associated with research on community college students: unobserved institutional 
effects and attendance at multiple institutions. The most consistent results across specifications 
are the negative relationship between individual success and larger institutional size, and the 
proportion of part-time faculty and minority students. 

JEL Classification: 121, 128 
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Community College Student Success: 

What Institutional Characteristics Make a Difference? 

1. Introduction 

Community colleges are a crucial point of access to higher education for low-income and 
minority students. Many of these students would not be in college if community colleges — or 
similar institutions — were not available (Alfonso, 2004; Rouse, 1995). The community college 
access mission is built on low tuition, convenient location, flexible scheduling, an open-door 
admissions policy, and programs and services designed to support at-risk students with a variety 
of social and academic barriers to postsecondary success (Cohen & Brawer, 1996). 

While community colleges have played a crucial role in opening access to higher 
education to a wide variety of students, access alone is not sufficient. In recent years, policy 
makers, educators, accreditors, and scholars have increasingly turned their attention to student 
persistence and completion, but most of the research and attention has focused on the educational 
outcomes of baccalaureate students and not those who begin at a community college. 

Many community college students never finish a degree. Indeed, for students who 
enrolled in a community college as their first postsecondary enrollment in the 1995-96 academic 
year, only 36 percent had completed either a certificate, associate, or bachelor’s degree within 
six years. Another 22 percent were still enrolled in college (about three-fifths of those were 
enrolled in a four-year institution). Therefore, 42 percent of students who started college in a 
two-year public institution left college within six years after initial enrollment without a degree 
or certificate. Low-income, minority, and first-generation college students all have even lower 
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six-year completion rates. And those who do complete among these populations tend to earn 
lower-level credentials — for example, a certificate rather than an associate or bachelor’s degree. 1 

How can community colleges improve their graduation rates? Certainly one strategy 
would be to be more selective. Extensive research has shown that students who have stronger 
high school records, who come from higher income families, whose parents also went to college, 
who do not delay college entry after high school, who attend full time, and who do not interrupt 
their college studies are more likely to graduate (Adelman, 1999; 2003; Bailey, Alfonso, Scott, & 
Leinbach., in press; Cabrera, Burkum, & La Nasa, in press). But such a strategy would defeat the 
purpose of the open-door community college institution. Community colleges are committed to 
providing a place in higher education for all students who meet minimum criteria. In many 
states, students can attend community college even if they do not have a high school diploma or 
equivalent and in many colleges, a majority of students, after being assessed, are determined not 
to be prepared for college level coursework. The question facing community colleges, then, is 
not how to attract better students (although surely many would like to do that), but rather how to 
do a better job with the types of students they already have. Indeed, there is some evidence that 
colleges differ in their effectiveness in helping students to graduate since community college 
graduation rates vary significantly, even after controlling for characteristics of the student body 
(Bailey, Calcagno, Jenkins, Leinbach, & Kienzl, in press). 

The goal of the study presented here is to identify institutional characteristics that affect 
the success of community college students. In this article, we examine several characteristics that 
are under the control of either the colleges or state policy makers. They include the size of the 
college; tuition levels; the use of part-time faculty; overall expenditures per student; the 
distribution of those expenditures among possible functions such as instruction, administration, 

1 Authors’ calculations from the Beginning Postsecondary Student Longitudinal Study of 1995-96. 
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and student services; the extent to which the college focuses on certificates as opposed to 
associate degrees; and the level of financial aid. 

While there is extensive research on the determinants of educational outcomes for K-12 
education (Hanushek, 1986; 2003) and a growing literature on this topic for baccalaureate 
institutions, few researchers have attempted to address the issue for community colleges. In this 
study we measure the probability that a student will have a successful educational outcome, 
controlling for both their individual characteristics and the characteristics of the institutions that 
they attend. Our sample is drawn from the National Education Longitudinal Study of 1988 
(NELS:88), which also provides our detailed individual level characteristics. Our institutional 
variables are drawn from the Integrated Postsecondary Education Data System (IPEDS). 

The structure of this article is as follows. Section 2 reviews the existing literature 
addressing the factors that affect student success rates at both baccalaureate institutions and 
community colleges. In Section 3 we introduce the empirical model using NELS and IPEDS data 
to measure the institutional effects on community college graduation rates. Section 4 presents the 
findings from this analysis, and in Section 5 we explore some of these findings in more detail 
and test the robustness of our analysis. Finally, we summarize and discuss our findings in 
Section 6. 



2. Existing Research 

Education economists have studied educational production functions for more than 30 
years. Also called an input-output approach, the method allows researchers to understand the 
effect of student and institutional characteristics on educational outcomes such as student 
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achievement. In widely-cited articles, Hanushek (1986; 2003) summarized the existing literature 
where questions like “Do schools make a difference?” or “Does money matter?” are repeatedly 
addressed. 

Research by economists on community college outcomes has focused on the economic 
payoff of enrolling in a two-year program and receiving a degree (Grubb, 2002; Kane & Rouse, 
1995; 1999) or on the effectiveness of transferring to a four-year institution (Ehrenberg & Smith, 
2004; Leigh & Gill, 2003; Rouse, 1995). As a result, production functions are not widely used to 
estimate the effect of student and institutional characteristics on higher education outcomes l ik e 
completion for community college students. 

The most widely used conceptual frameworks of persistence and completion developed 
by education researchers are based on Tinto’s Student Integration Model (1993) and Bean’s 
Student Attrition Model (1985). These models have generated an immense amount of research 
and conceptual development. The central institutional implication of the models is that 
administrators and faculty should try to foster the academic and social engagement of their 
students in and with the colleges. The large majority of the research inspired by these models has 
consisted of single institution studies which do not allow an analysis of the influence of 
differences in institutional characteristics (Bailey & Alfonso, 2005). Drawing on the various 
theories that have emerged from the engagement models, Titus (2004; in press) developed a list 
of institutional characteristics that might influence student persistence, including control (public 
or private), whether the college is residential, college size, sources of revenue, and patterns of 
expenditure. Other than those variables, all of the other institutional variables concern the 
characteristics of the institution’s students. The hypothesis is that the goals, characteristics, 
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academic performance, and behavior of a student’s peers have an influence on that student’s 
persistence. 

There has also been extensive research on individual postsecondary educational outcomes 
using nationally representative samples such as the Beginning Postsecondary Student 
Longitudinal Study (BPS) and NELS, and this research has shown that students who have 
stronger high school records, who come from higher income families, whose parents went also 
went to college, who do not delay college entry after high school, who attend full time, and who 
do not interrupt their college studies are more likely to graduate (Adelman, 1999; 2003; Bailey et 
al., in press; Cabrera et al., in press). However, the models in these studies do not account for 
variation among institutions and their effects on student outcomes. That is, they do not consider 
that the characteristics of the institution that a student attends might influence his or her outcome. 

In contrast, the growing production function research on colleges takes the institution as 
the unit of analysis and estimates the influence of institutional characteristics (including average 
student characteristics) on college graduation rates (Astin, Tsui, & Avalos, 1996; Mortenson, 
1997; Porter, 2000; Ryan, 2004; Scott, Bailey, & Kienzl, in press). Almost all of this work has 
concerned four-year colleges and the research generally concludes that colleges serving students 
with higher SAT scores and from higher income families, with higher proportions of full-time 
and female students, and higher instructional and academic support expenditures per full-time 
equivalent (FTE) student, have higher graduation rates. Only one study has conducted this 
analysis for community colleges (Bailey et. al., in press), and it concluded that institutions with a 
larger enrollment and a high share of minority students, part-time students, and women have 
lower graduation rates. In addition, their results confirm that greater instructional expenditures 
are related to a greater likelihood of graduation. 



5 




Titus (2004; in press) has recently published research on persistence in four-year colleges 
that includes both institutional and individual characteristics. He merged two nationally 
representative datasets (BPS:96/98 and IPEDS 1995) to consolidate individual student data with 
the institutional information from the college where each student enrolled. He concluded that 
persistence is higher at more selective, residential, and larger institutions (Titus, 2004). In a 
subsequent paper he analyzed the effects of financial variables and found that a higher 
expenditure per full-time equivalent student is associated with greater persistence, although 
within expenditures, colleges with relatively higher administrative expenditures tended to have 
lower persistence. Graduation rates were also higher at colleges in which a larger share of 
revenue came from tuition. 

Therefore, over the last two decades, researchers have developed an extensive empirical 
literature on college persistence. Our research contributes to this literature in three ways. First, 
we use a production function framework with both college-level and individual variables to 
analyze the institutional correlates of persistence, completion, and transfer in community 
colleges. Little of the existing research explicitly analyzes the influence of institutional 
characteristics, and those researchers who have done so, with one exception, studied four-year 
colleges. Further, with the exception of Titus, even those studying institutional factors in four- 
year colleges have not controlled for individual level variables, as we have done. 

Second, many students now attend more than one postsecondary institution (Adelman, 
1999; 2003; Burd; 2004). Given the growth of multi-institutional attendance, particularly among 
students who enter higher education through community colleges, our study incorporates the 
effect on a student’s educational outcome of every institution attended. We thereby account for 
the entire undergraduate experience of a student. The graduation rates used in most of the 
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research on institutional determinants of persistence (the research that uses the institution as the 
unit of analysis), do not include students who transfer to another institution; students who 
transfer are counted as dropouts rather than as potentially successful transferees. By using 
individual data we were able to track students as they move among institutions, keeping in mind 
that each institution contributes to the intellectual and social development of the student and 
affects his or her educational outcome. 

Third, unobserved institutional factors like leadership, faculty relations, and local 
political environment may have a bearing on students’ outcomes. We therefore used a technique 
that takes account of unobserved institutional characteristics to compute consistent coefficients 
for the observable variables. 



3. Empirical Model and Data 



3.1 Econometric Models 

In this paper we define a community college student as successful if he or she attains any 
degree (certificate, associate, or bachelors) or transfers to a four-year institution. Therefore, we 
coded the dependent variable as a binary one with a value of unity if we observed any of the 
mentioned successful outcomes, and zero otherwise. Following the discussion in the last section, 
we used both students and institutional characteristics to explain community college student 
success. By restricting our analysis to students whose initial postsecondary institution was a 
community college, we could model the probability that a student will succeed as follows: 
y*c= x LP + v ie i = 1,2, ..., N and c = 1, 2, ..., C (1) 

and y ic = 1 if y* > 0 and = 0 otherwise 
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where i denotes each student and c is the cluster, in this case, the community college, y* , is the 
unobservable individual propensity to graduate, y is the observed outcome, X is a vector of 
exogenous students and institutional characteristics that affect the outcome and v; t is the 
unobserved component. Under usual assumptions for the error component (mean zero, 
normalized variance al equal to one), we could pool the data and use a standard Probit model 
(henceforth, Model 1): 

Prob[y ic = l| X ic ]=® (x' c /?) (2) 

where ® (.) denotes the standard normal cumulative density function. Maximum Likelihood 
estimation guarantees asymptotically unbiased estimates. However, standard errors will be 
misleading and need a robust variance-covariance matrix to account for serial correlation within 
institutions (Guilkey & Murphy, 1993; Wooldridge, 2002). 

Our Model 1 assumes that heterogeneity in students’ probability to graduate is only 
affected by observable characteristics of the institution. However, other unobserved institutional 
factors like leadership, faculty relations, and the local political environment may have a bearing 
on students’ outcomes. Moreover, research on graduation rates at baccalaureate institutions often 
finds that more selective institutions have higher graduation rates than those enrolling less 
academically ready students (Astin et al., 1996; Pascarella & Terenzini, 1991; 2005). 
Nevertheless, there is not a widely used and available measure of the academic preparedness of 
community college students. Our Model 2 is designed to account for the institution-level 
unobserved factors that may affect the individual’s propensity to graduate. We decompose the 
error term in equation (1) as follows: 

v ic = a c + u ic (3) 
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